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BACKGROUND 

20 

Field of the Invention 

The present invention relates to translating addresses for communications 
across computer networks. More specifically, the present invention relates to a 
method and an apparatus for providing multiple load balancers to balance 
25 translation requests across multiple name servers. 



Related Art 

As the Internet continues to grow at an exponential rate, the existing 
Internet infrastructure must continually expand to keep pace with increasing 
30 network traffic. One problem in this expansion is to ensure that mechanisms that 
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translate host names into Internet Protocol (IP) addresses continue to operate in 
the face of an increasing volume of translation requests. 

Note in order to send a message across a network, it is necessary to include 
the destination address in the message. This destination address is typically a 32- 
5 bit number, which is referred to as an IP address. 

However, 32-bit IP addresses tends to be hard for a human being to 
remember. For this reason, the domain name system (DNS) is used to provide 
more easily remembered logical names, which are referred to as "host names". By 
referring to a host through a host name, a network user does not have to remember 
10 the IP address which specifies the physical location of the host. Moreover, the 
host may be moved to a different network while users continue to use the same 
logical host name. 

The domain name system operates through use of a database that contains 
translations between logical host names and IP addresses. This database is 

1 5 distributed between a plurality of name servers. In sending a message to a host, a 
translation between the logical host name and the IP address typically takes place 
at a name server, which contains records of host name to IP address translations. 

As network traffic continues to increase, name servers are beginning to 
experience a tremendous volume of requests. In order to service these requests, 

20 some systems have begun to employ multiple name servers that operate in 

parallel. In this type of system, address translation requests are typically received 
by a centralized load balancer that distributes the requests to the multiple name 
servers. 

However, as the number of requests for address translations continues to 
25 increase, a single load balancer is often not able to keep pace with the large 

volume requests that are directed to the multiple name servers. Moreover, if the 
load balancer fails or must be stopped for routine maintenance, no address 
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translations can take place because the load balancer is unavailable to route 
address translation requests. 

What is needed is a method and an apparatus for routing address 
translation requests without the performance and reliability problems associated 
5 with existing systems that use a single load balancer. 

SUMMARY 

One embodiment of the present invention provides a system that translates 
host names into Internet Protocol (IP) addresses. This system includes a plurality 

10 of name servers that are configured to translate host names into corresponding IP 
addresses. This system also includes a plurality of load balancers coupled to the 
plurality of name servers. Each of these load balancers is configured to receive 
requests for host name translations, and to distribute these requests between the 
plurality of name servers in order to balance load across the plurality of name 

15 servers. Note that these load balancers are configured to operate in parallel in 
distributing requests between the plurality of name servers. 

In one embodiment of the present invention, each of the load balancers is 
associated with its own IP address, and is configured to process translation 
requests directed its own IP address. 

20 In one embodiment of the present invention, each of the load balancers is 

configured to take over load balancing operations for one or more failed load 
balancers. 

In one embodiment of the present invention, the load balancers are 
organized into a ring. Within this ring, each load balancer is configured to take 
25 over load balancing operations for a neighboring load balancer, if the neighboring 
load balancer fails. 
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In one embodiment of the present invention, each load balancer is a proxy 
server that is configured to accept user datagram protocol (UDP) and transmission 
control protocol (TCP) connections from domain name system (DNS) clients, and 
to forward corresponding UDP or proxy TCP requests to the plurality of name 
5 servers. 

In one embodiment of the present invention, each of the plurality of load 
balancers is configured to distribute translation requests between the plurality of 
name servers based upon measured response times of the plurality of name 
servers. 

10 In one embodiment of the present invention, the system includes an 

internal communication network that couples the plurality of load balancers with 
the plurality of name servers. 

One embodiment of the present invention provides a system that translates 
a host name into an Internet Protocol (IP) address. Upon receiving a translation 

15 request to translate the host name into the IP address, the system selects a name 
server to process the translation request. This selection is based upon a measured 
load of the name servers. This ensures that overloaded name servers will not be 
selected. Next, the system forwards the translation request to the selected name 
server, so that the selected name server can translate the host name into the IP 

20 address. 

In one embodiment of the present invention, the system additionally 
measures a load on the name servers by periodically sending an information 
request to each name server, and measuring a response time for the request. 

One embodiment of the present invention provides a system that performs 
25 failovers between a plurality of load balancers that are configured to balance 
requests for host name to IP address translations between a plurality of name 
servers. The system operates by sending a keep alive packet from a load balancer 
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to a first neighboring load balancer, and then waiting for a response to the keep 
alive packet in order to determine if the first neighboring load balancer remains 
alive. If the first neighboring load balancer does not remain alive, the load 
balancer takes over servicing of translation requests directed to the first 
5 neighboring load balancer. 

In one embodiment of the present invention, the system receives a second 
keep alive packet from a second neighboring load balancer, and sends a response 
to the second keep alive packet to the second neighboring load balancer. 

1 0 BRIEF DESCRIPTION OF THE FIGURES 

FIG. 1 illustrates a distributed computing system in accordance with an 
embodiment of the present invention. 

FIG. 2 is a flow chart illustrating the process of forwarding an address 
translation request from a load balancer to a name server in accordance with an 
1 5 embodiment of the present invention. 

FIG. 3 is a flow chart illustrating the process of measuring response times 
for name servers in accordance with an embodiment of the present invention. 

FIG. 4 is a flow chart illustrating the process of monitoring a neighboring 
load balancer and taking over for the neighboring load balancer if the neighboring 
20 load balancer fails in accordance with an embodiment of the present invention. 



DETAILED DESCRIPTION 

The following description is presented to enable any person skilled in the 
art to make and use the invention, and is provided in the context of a particular 
25 application and its requirements. Various modifications to the disclosed 

embodiments will be readily apparent to those skilled in the art, and the general 
principles defined herein may be applied to other embodiments and applications 
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without departing from the spirit and scope of the present invention. Thus, the 
present invention is not intended to be limited to the embodiments shown, but is 
to be accorded the widest scope consistent with the principles and features 
disclosed herein. 

5 The data structures and code described in this detailed description are 

typically stored on a computer readable storage medium, which may be any device 
or medium that can store code and/or data for use by a computer system. This 
includes, but is not limited to, magnetic and optical storage devices such as disk 
drives, magnetic tape, CDs (compact discs) and DVDs (digital versatile discs or 
10 digital video discs), and computer instruction signals embodied in a transmission 
medium (with or without a carrier wave upon which the signals are modulated). 
For example, the transmission medium may include a communications network, 
such as the Internet. 

15 Distributed Computing System 

FIG. 1 illustrates a distributed computing system 100 in accordance with 
an embodiment of the present invention. Distributed computing system 100 
includes clients 124-125, which are coupled through network 122 to hosting 
system 101. 

20 Network 122 can generally include any type of wire or wireless 

communication channel capable of coupling together computing nodes. This 
includes, but is not limited to, a local area network, a wide area network, or a 
combination of networks. In one embodiment of the present invention, network 
122 includes the Internet. 

25 Clients 124-125 can generally include any node on a network including 

computational capability and including a mechanism for communicating across 
the network. 
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Hosting system 101 makes a number of applications available to clients 
124-125 across network 122. In order to do so, hosting system 101 includes a 
local network 110 that is coupled to network 122 through interface 120. In one 
embodiment of the present invention, local network 1 10 includes a 1 -gigabit local 
5 area network. 

Local network 1 10 is coupled to virtual servers 111-113, which host 
applications that can be accessed by clients 124-125. Note that each virtual server 
111-113 operates within its own virtual environment on a physical server. This 
allows multiple virtual servers to be located on the same physical server without 
1 0 interfering with each other. 

Local network 1 10 is additionally coupled to a number of name servers 
102 through load balancers 106-108. In one embodiment of the present invention, 
name servers 102 are configured to service requests to translate host names into IP 
addresses for hosts that are associated with virtual servers 111-113. In order to 
1 5 process these requests, load balancers 1 06-1 08 receive the requests and route them 
through routing network 104 to name servers 102. Name servers 1 1-1 13 are 
selected to receive requests based upon measured response times. This ensures 
that name servers that are heavily loaded are not selected to receive additional 
requests. 

20 In one embodiment of the present invention, each load balancer 106-108 is 

accessed through its own IP address, and this IP address is different from the IP 
address of the other name servers. Note that for return communications from 
name servers 102 to clients 124-125, the source address for the return 
communication is configured to be the IP address of the load balancer that 

25 originally forwarded the request. This makes the return communication appear to 
originate from the IP address of the load balancer that originally forwarded to 
request. 
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In one embodiment of the present invention, the load balancers 106-108 
are organized into a ring and are configured so that if one or more of the load 
balancers 106-108 fail, neighboring load balancers in the ring can take over for the 
failed load balancer. 

5 The name servers 102 illustrated in FIG. 2 operate generally as follows. A 

client 124 sending a message to a virtual serer 1 1 1 first obtains the IP address of 
the virtual server 111. This is accomplished by sending a host name for the 
virtual server 1 1 1 through load balancers 106-108 to one of name servers 102 (A). 
Recall that the name server is selected based upon load. Next, the selected name 
10 server translates the host name into a corresponding IP address and returns the IP 
address to client 124 (B). Finally, client 124 uses the IP address to communicate 
directly with virtual server 1 1 1 (C). 

Process of Forwarding a Translation Request 

15 FIG. 2 is a flow chart illustrating the process of forwarding a request from 

a load balancer to a name server in accordance with an embodiment of the present 
invention. A load balancer 106 first receives a request for a host name translation 
from a client 124 (box 202). Next, load balancer 106 uses a set of rules to 
determine if the request is valid (box 204). If not, the system generates an error 

20 message (box 209). Otherwise, if the request is valid, the system determines 
whether a name server is available to process the request (box 206). This may 
involve measuring response times for name servers 102 as is described in more 
detail below with reference to FIG. 3. If no name servers are available, the system 
generates an error message (box 209). Otherwise, if at least one name server is 

25 available, the system selects one of the available name servers based upon 

measured response times (box 208). This is done to ensure that a highly loaded 
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name server is not selected if a lightly loaded name server is available. Load 
balancer 106 then forwards the request to the selected name server (box 210). 

Process of Measuring Name Server Response Times 

FIG. 3 is a flow chart illustrating the process of measuring response times 
for name servers in accordance with an embodiment of the present invention. In 
order to measure response times, a load balancer 106 first loads a list of name 
servers from a database or other storage area (box 302). Load balancer 106 then 
sends an information request to each name server on the list (box 304). Next, load 
balancer 106 listens for responses and measures response times for each of the 
name servers on the list (box 306). Load balancer 106 next makes a record to 
indicate that any name server that did not respond is unavailable (box 308 Load 
balancer 106 also determines whether all remaining name servers responded 
within a threshold time period (box 310). If any of the name servers did not 
respond within the threshold time period, they are considered to be overloaded, 
and the load balancer 106 limits the sending of additional requests to these 
overloaded name servers (box 312). Note that this threshold time is selected to 
ensure a reasonable response time. Also note that load balancer 106 periodically 
repeats the above process in order to keep track of the load on name servers 102 
(box 314). 

Process of Monitoring and Taking Over For A Neighboring Load Balancer 

FIG. 4 is a flow chart illustrating the process of monitoring a neighboring 
load balancer and taking over if the neighboring load balancer fails in accordance 
with an embodiment of the present invention. Each of the load balancers 106-108 
continually performs the below-described process. 
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This process starts when a load balancer 106 loads a list of all of the load 
balancers in the system 106-108 (box 402). Recall that in the embodiment of the 
present invention illustrated in FIG. 1, these load balancers are organized into a 
ring. Next, load balancer 106 opens a connection to a first neighboring load 
5 balancer in the ring, for example to load balancer 107 (box 404), and then sends 
keep alive packets to load balancer 107 (box 406). By listening for responses to 
these keep alive packets, load balancer 106 can determine whether load balancer 
107 remains alive. 

At the same time, load balancer 106 accepts a connection from a second 
1 0 neighboring load balancer in the ring (box 408), for example from load balancer 
108. Next, load balancer 106 sends responses to any keep alive packets received 
from load balancer 108 (box 410). In this way, load balancer 106 continually 
notifies load balancer 108 that load balancer 106 remains alive. 

If load balancer 106 determines that load balancer 107 is alive because 
15 responses to keep alive packets sent to load balancer 107 have been received, the 
system repeats the process (box 414). Otherwise, if no responses to the keep alive 
packets are received from load balancer 107, load balancer 106 determines that 
load balancer 107 is not alive. In this case, load balancer 106 takes over the IP 
address for load balancer 107, and handles all subsequent requests that are 
20 directed to load balancer 1 07 (box 413). 

Note that if another adjacent load balancer fails, such as load balancer 108, 
load balancer 106 takes over for load balancer 108 in a subsequent iteration 
through the loop. 

The foregoing descriptions of embodiments of the present invention have 
25 been presented for purposes of illustration and description only. They are not 

intended to be exhaustive or to limit the present invention to the forms disclosed. 
Accordingly, many modifications and variations will be apparent to practitioners 
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skilled in the art. Additionally, the above disclosure is not intended to limit the 
present invention. The scope of the present invention is defined by the appended 
claims. 
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